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We study the RKKY interaction mediated by the helical edge states of a quantum spin Hall 
insulator in the presence of the Rashba spin-orbital coupling induced by an external electric field 
and the electron-electron interaction. We show that in the presence of the Rashba coupling, the 
RKKY interaction induced by the helical edge states contains not only the Heisenberg-like and the 
Dzyaloshinskii-Moria terms but also the nematic-type term that is not present originally, with the 
range functions depending on the strength of the Rashba coupling. We also show that the electron- 
electron interaction changes the strength of the RKKY interaction by modifying the power of the 
l/|a;| dependence of the range functions. In particular, by varying the strength of the interaction 
or the Rashba coupling, there is an (impurity) quantum phase transition involving the sign change 
of the RKKY interaction at the value of the Luttinger liquid parameter K = 1/2. Since both the 
strength of the Rashba coupling and the chemical potential of the helical edge states are electrically 
controllable by external gate voltages, our results not only shed light on the nature of magnetic 
impurity correlations in the edge of a two-dimensional topological insulator, but also pave a way to 
manipulate the qubits in quantum computing. 

PACS numbers: 71.10.Pm 71.70.Gm 75.20.Hr 75.70.Tj 


I. INTRODUCTION 

Over the past few years, the study of topological states 
of matters with or without topological order has at¬ 
tracted a lot of attention in the condensed matter com¬ 
munity. The exploration of these new states of matter not 
only enriches the traditional condensed matter physics, 
but also has important implications in other branches of 
physics, such as quantum information science and quan¬ 
tum computing^ Among these topologically nontrivial 
states, a special class of states, known as the symmetry- 
protected-topological (SPT) states, has the special prop¬ 
erty that while the excitations in the bulk are gapped and 
trivial, they contain robust gapless edge excitations pro¬ 
tected by the symmetries of the system. A prototypical 
example of the SPT state is the two-dimensional quan¬ 
tum spin Hall insulator (QSHI) which has a finite gap 
for bulk excitations and two counter-propagating gapless 
edge modes with opposite spin polarizations^^ This he¬ 
lical edge state is guaranteed to be stable against the 
weak interaction and disorder due to the time-reversal 
(TR) symmetry. Experimental evidences of this unique 
gapless one-dimensional (ID) quantum liquid are found 
based the the transport measurements— £ 

In addition to the charge transport properties, the spin 
physics may provide an additional complementary signa¬ 
ture of the topological states of matter. This is partic¬ 
ularly interesting for the edge states of the QSHI be¬ 
cause the spin polarizations are associated with the di¬ 
rections of their momenta. One way to detect this fea¬ 
ture may be provided by the Ruderman-Kittel-Kasuya- 
Yoshida (RKKY) interaction^ which is an effective in¬ 
teraction between two local spins mediated by itinerant 



QSHI 


FIG. 1: (Color online) Schematic setup of two local spins 
Si and S 2 located near the helical edge states of a QSHI 
which occupies the xy- plane with y < 0. The local spins can 
be realized by quantum dots with strong on-site interactions. 
Both are exchange-coupled to the spin density of the helical 
edge states, denoted the dashed lines. The solid lines show 
the directions of the momenta of the edge states, with the 
associated spins indicated by the arrows. 


electrons in the host metals. A good understanding on it 
may form the basis for manipulating the quantum states 
of local spins, which can be crucial for the spintronics 
and quantum computing*^ With this in mind, it is not 
surprising that the interplay between the RKKY interac¬ 
tion and topological states of matter has attracted a lot of 
attentions. For examples, the RKKY interaction on the 
surface of a three-dimensional topological insulator— 
and the edge of a QSHlii have been studied. More re¬ 
cently, the RKKY interaction mediated by helical Majo- 
rana edge states in a TR-invariant topological supercon¬ 
ductor was also investigated— In Ref. [lj, the RKKY 
interaction mediated by the helical edge sate of the QSHI 
contains an in-plane non-collinear exchange coupling be¬ 
tween two local spins, in contrast to the isotropic cou- 
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pling induced in normal metals^ 

It is known that the HgTe quantum wells in which the 
QSHI was first experimentally discovered exhibit some 
of the largest known Rashba spin-orbit coupling (SOC) 
among semiconductor heterostructures Theoretically, 
it was also shown that such a coupling in helical liquids 
leads to interesting new Kondo physics d 7 ' 18 Therefore, 
it is desirable to see how the Rashba coupling affects the 
RKKY interaction in the helical liquid. Moreover, in the 
ID quantum liquid, it is well-known that the electron- 
electron interaction leads to the breakdown of the Fermi 
liquid picture and the correct low-energy physics is de¬ 
scribed by Luttinger liquid (LL)J^ Thus, a physically 
more accurate and realistic description of the RKKY in¬ 
teraction in the helical liquid must go beyond the sim¬ 
plest model employed in Ref. El by taking into account 
both the above elements. 

In this paper, we consider two local spins exchange- 
coupled to the spin density of the edge states of a QSHI. 
A schematic setup is shown in Fig. |T] We would like 
to study the effects of the Rashba SOC and the electron- 
electron interaction on the RKKY interaction in the heli¬ 
cal edge states. Since the strength of the Rashba coupling 
can be tuned by an external gate voltage, we expect that 
the correlations between the two local spins may be af¬ 
fected by the applied gate voltage through the Rashba 
SOC. Our main findings are as follows, (i) The spin 
structure of the resulting RKKY interaction is fixed by 
the spin symmetries of the system. With the inclusion of 
the Rashba coupling, it consists of the Heisenberg-like, 
the Dzyaloshinskii-Moria (DM), and the nematic-type 
terms. The last one is absent by turning off the Rashba 
coupling. All terms contain the range functions of the 
forms cos {qx)/\x\ or sin(gx)/|x|, where |x| is the separa¬ 
tion between the two local spins and q = 2 n/v F with the 
chemical potential /r and the renormalized Fermi velocity 
vf- (ii) The electron-electron interaction does not affect 
the spin structure of the RKKY interaction because the 
latter is determined by the spin symmetries of the sys¬ 
tem. Its only effect is to modify the range functions which 
become 'y(K) cos (qx)/\x \ 2K ~ 1 or 'y(K) sin (gx)/|a:| 2A_1 , 
where K is the LL parameter and the non-universal con¬ 
stant 7 (K) changes the sign from K < 1/2 to K > 1 / 2 . 
(iii) By solving the two-impurity problem, we find that 
there exists a critical strength of the electron-electron 
interaction corresponding to K = 1 / 2 . At that point 
a quantum phase transition occurs because of the sign 
change of the range functions, (iv) From the solution 
of the two-impurity problem, we may examine how the 
entanglement between the two local spins is affected by 
the Rashba coupling. Since the latter can be tuned by 
the external gate voltage, our results provide a way to 
control the correlations between the two local spins and 
may have further applications on spintronics and quan¬ 
tum computation. 

The rest part of the paper is organized as follows. In 
Sec. HD we setup our model and discuss the spin symme¬ 
tries of the system and the approximation we have made. 


The calculation of the RKKY by taking into account the 
Rashba coupling and the electron-electron interaction is 
presented in Sec. ED We solve the resulting two-impurity 
problem in Sec. |lVl Finally, the last section is devoted 
to a conclusive discussion. 


II. THE MODEL AND THE SYMMETRIES 

Our setup shown in Fig. [T] can be described by the 
Hamiltonian H = Hq + Hint + H ex when the energy is 
much lower than the bulk gap, where Hq is Hamiltonian 
for free edge electrons, H lnt gives the interaction between 
them, whose form will be given later, and H ex describes 
the exchange interaction between the local spins and the 
spin density of the helical edge states. By taking into 
account the Rashba SOC, Ho can be written as 

H 0 = J dx^[v F (cos 9 a 3 id x + smda 2 id x )— /i]’F 

v F a 3 id x + aa 2 id x - /i)’F , (1) 

where T = with ip + = ip l-\- and ip- = ipRi, 

v F is the Fermi velocity, a denotes the strength of the 
Rashba coupling, vp = ■\Jv F + a 2 , sin# = a/vF, and 
cosd = vf/v F ■ On account of the SOC present in this 
system, H ex may be anisotropic, and thus we write it in 
the form 

Hex =E E J aStO a s {Xi) , (2) 

i a=x,y,z 

where J x = J y = J± ^ J z , 6“ = ’R 1 cr„T / with a x ,y : z 
being Pauli matrices, and Si is the local spin at point 27. 

Before plunging into the calculation of the RKKY 
interaction, we investigate the spin symmetries of the 
Hamiltonian Hq + H ex . First of all, we notice that for 
0 / 0 and J_l = J z , Hq + H ex is invariant against spin 
rotations about the x-axis, which will be dubbed as the 
spin U x (l) symmetry. This can be shown as the follow¬ 
ing. Let U x {4>) denote the spin rotation about the x-axis 
by angle cp. Sj with j = 1,2 and Of are invariant, while 
Sj and S? with j = 1,2 transform like 

U x { 4 >)SjUl((p) = Sj cos <p + Sj sin <p , 

U x {<p)S Z jUl{(P) = -S y jSin<p + S Z jCOS(P , ( 3 ) 

and similar expressions for Of and Of. On the other 
hand, transforms like 

§ = U x {<p)^ = . (4) 

In terms of Eqs. Q and (| 4 |), one may show that 

U x (</>) [H 0 ( 9) + H ex ]Ul ( cP) = Ho{6-cP) + H ex , ( 5 ) 

if J± = J z . 
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Next, for 9 = 0, the spin symmetry of Hq + H ex be¬ 
comes the spin U~(l), i.e. the Hamiltonian Hq + H ex 
is invariant against spin rotations about the z-axis. Fi¬ 
nally, Hq + H ex has the exchange symmetry. That is, it 
is invariant against the exchange of Si and S 2 ■ We shall 
see later that the three spin symmetries, the spin U x (l) 
symmetry, the spin U z (l) symmetry, and the exchange 
symmetry, will impose constraints on the possible forms 
of the RKKY interaction. 


III. THE RKKY INTERACTION 

Now we are in a position to calculate the RKKY in¬ 
teraction in the helical liquid. We shall work in the 
imaginary-time formulation. By integrating out the edge 
electrons, the resulting RKKY interaction takes the form 

Hrkky = Y JaJ b n ab (x)S^S b 2 , (6) 

a,b—x,y,z 

where x = X\ — X 2 and 

/ +00 

dr{Tr{d a s {r,Xi)d a s { 0,® 2 )}> , 

-OO 

is the Fourier transform of the spin-spin correlation func¬ 
tion of the helical edge states at zero frequency and zero 
temperature, with T t denoting the time ordering in the 
imaginary-time formulation. 


A. The role of the Rashba coupling 

We first study the free helical liquid by ignoring Hi nt . 
For the free helical liquid, the spin-spin correlation func¬ 
tion is the product of two single-particle Green functions: 

s\ ?!(r) ee -(Tr{d a s (r,x 1 )6 a s (0,x 2 )}) 

— [Ga)\pG •) X2)Gpoii^ 'T - 5 15 ^2) ? 


where 


G a p(r\ aq, £ 2 ) = -(Tr{4’ a (T,x 1 )4>^(0 1 x 2 )}) , 

is the single-particle Green function. With the help of 
the spectral representation of the single-particle Green 
function 


r u .rr - [ + °° dv > 

ya/3 *El 1 %2) — / 0 

J —00 


dv Pcifi{y , 3^1 5 ^ 2 ) 


lUJ n — V 


where Gotp(ioJ n \ # 2 ) denotes the Fourier transform of 
G a p(r; #i, £ 2 ) with uj n = (2n+l)-7rT and p a p( # 1 , X 2 ) is 
the spectral function of electrons, one may write II a b(x) 
as 


n ab(x) = W ab (x ) - 1 - Wba(—x) , 


at T = 0, where 


Wab(x) 



e“ l0+ 
wi — w 2 


xtr{cr 0 [p](wi; x)a b [p\{u 2 \~x)} . 


The rest of task is to determine the matrix \p\(w,x) for 
the helical liquid. 

For the free helical liquid, we find that 


2 

\p](w,x) = ——sin (Cox/vf)(vfct z + aa y ) 

V F 

-\-—cos(Qx/vf)(Jo, (7) 

Vf 

where u> = w + p and <tq is the 2x2 unit matrix. In 
terms of Eq. 0, we get 

H rkky = V^(x)(S 1 x S 2 ) z + V^ M (x)(Si x S 2 ) v 
+V n (x)(S\S~ + SIS V 2 ) 

+ Y V a (x)SfS$ , (8) 


where the range functions are given by 


V x (x) = - 


J\N{ 0 ) 

— cos (qx) 


V V (X) = - 


J±N(0) cos 2 9 


cos (qx) 


J Z N( 0) sin 2 9 

V z (x) = -cos (qx) 


_ 

2\x\ 

(i) , A J\N( 0) cos6» . 


^DM ( X ) — 


Vdm( x ) — 


sin (qx) , 


J±J z N(0) sin0 


sin (qx) ■ 


( 9 ) 


In the above, q = 2 p/vf and 1V(0) = 1/(2ttvf) is the 
density of states (DOS) at the Fermi level for fermions 
with linear dispersion. The V x , V y , and V z terms are 

Heisenberg-like, the vf-jl r and V^ M terms are DM-like, 
and the V n term is the nematic type. The l/\x\ depen¬ 
dence of the range functions is a characteristic of the ID 
free electrons^ 

A few comments on Eqs. 0 and 0 are in order. First 
of all, we notice that V z (x) = 0 = Vp,l I (x) = V n (x) in the 
absence of the Rashba coupling. This must be the case 
because all terms in Hrkky arise from the backscat- 
tering of the host electrons. For the helical liquid, the 
backscattering processes have to be accompanied by the 
spin flip of electrons. On the other hand, nonvanishing 
Vz, Vjj^. or V n terms imply the existence of backscatter¬ 
ing processes which do not involve the spin flip at least 
in one of the spin locations. When the Rashba SOC is 
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turned on, the spin quantization axis is rotated so that 
these terms are allowed. Next, we would like to show 
that the spin structure of Hrkky is fixed by the spin 
symmetries of the system. Using Eq. ©, one may verify 
that 

U x {<t>)Hi(9)Ul((t>) = Hi(9- 4>) , 
for l = 1,2 when J± = J z , where 


commutation relation [4>(a;), 0(y)] = i9(y — x), where 
^(x) = 1, 1/2, and 0 for x > 0, x = 0, and x < 0, 
respectively. The LL parameter K = 1 in the absence 
of Hi n t, while K < 1 and K > 1 for repulsions and 
attractions, respectively. 

The actual value of K depends on g i and g 2 , where 
9i = U1 - ^ Sin 2 e J31 + i sin 2 0g 2 , 


Hr = Y, v °W s i s * +v "( x K s i s * +s ’ s *)> 

a—y,z 

H 2 = V^WiSr x S 2 ) z + V^(*KSi x S 2 ) y , 


is the corresponding coupling constant in the transformed 
interacting Hamiltonian U x (9)Hi nt U^(9). In the weak- 
coupling regime, we have 


while the V x term is invariant against the spin U x (l) 
rotations. Hence, we conclude that 

U x {(j))H RK KY{Q)Ul((j >) = H RK ky(Q — 4 >) , (10) 

when J± = J~. When 9 = 0, it is straightforward to 
show that Hrkky respects the spin U 2 (l) symmetry. 
Furthermore, Hrkky is invariant against the exchange 
of S i and S 2 . 


B. The effects of the electron-electron interaction 

Now we take into account the electron-electron inter¬ 
action. We shall assume that the helical liquid is still 
in the LL phase in the presence of the electron-electron 
interaction. Thus, the most general form of Hi nt is given 
by 


Hint — J dx ^ (q / g 2 J _j_ J — 


( 11 ) 


where J a = 'i/4-Vv- One may show that the rotated inter¬ 
acting Hamiltonian U x (4>)Hi n tU\((j)) still takes the form 
of Eq. (fill) , except that the coupling constant g\ ac¬ 
quires the (j) dependence. In this sense, the Hamiltonian 
H = H 0 + H int + Hex respects the spin U x (l) symmetry. 
Consequently, Eq. m still holds in the presence of H lnt 
when Jj_ = J~. Especially, we may take (f> = 9 and it 
suffices to calculate n o f ,(x) in the absence of the Rashba 
SOC. 

In terms of the bosonization formula^ 

$±{x) = 1 p T^x/vf p TiV^<t>±{x) 5 

\/27rao 

where ao is the short-distance cutoff and \h\/vf is the 
Fermi momentum, the helical liquid with 9 = 0 can be 
described by the Hamiltonian 



K(d x e) 2 + -^(d x $) 2 


( 12 ) 


at low energy, where $ = </ + + (/_, O = </ + — , and v 

is the speed of collective excitations. $ and O obey the 



where Vo = Wf[1 + Qi/^Vf)}- Since g i depends on 9, 
both K and v are functions of 9 (and thus a). Be¬ 
cause the coupling to magnetic impurities may induce 
the two-particle backscattering potential which will cut 
the helical edge state into two pieces and drive the sys¬ 
tem into an insulating phase for K < 1/4 ) 20 ' 21 we shall 
restrict ourselves to the region with K > 1/4 hereafter. 
Moreover, in order that the LL description is valid and 
the Hondo effect can be neglected, we must require that 
ao <C \x\ — x 2 \ -C vf/Tk, where Tr is the Hondo tem¬ 
perature. 

Upon bosonization, the components of the spin density 
operator O s can be written as 


6 ? = _J_ e 2 W®F e iV473. +Hc 
27rao 

QV = _J_ e 2 ii,x/v Fe iV^<S> +Hc 
27rao 

d; = -^d x e. 
vbr 


(13) 


In terms of Eq. m , the calculation of the spin-spin 
correlation functions is standard^ and the nonvanishing 
components at zero temperature are 


S%(t) 

1 

27r 2 aQ 


= Sr 2 (r) 

«sri(r) 

1 

27r 2 ag 


-.if 


(u|t| + ao) 2 + x 2 


COS( qx) 


if 


sin (qx) 


= -^(r) 


(14) 


(15) 


and 


S zz ( s = 1 f (v\t\ + ap) 2 - x 2 ) 

12 [> 2n 2 K\((v\T\+ao) 2 + x 2 } 2 }' 


(16) 


for 0 = 0. 

With the help of the above results and performing the 
spin U x (l) rotation, Hrkky still takes the form of Eq. 
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© , but the range functions are replaced by the following 
ones: 


V x (x) 

V y (x) 

V,(x) 

V n (x) 

Vdm( x ) 

Vdm( x ) 


J±y{K)N(0) 


12 K 


cos (qx) , 


JIj(K)N{ 0) cos 2 e 


I2K-1 


cos (qx) 


J 2 ~/(K)N(0) sin 2 9 


\2K-l 


cos (qx) 


J±J z 'y(K)N(0)sm(29) 


2 \x 


2K-1 


COS (qx) 


J±'Y(K)N (0) cos 9 


| 2 A '-1 


sin (qx) 


J±Jz'Y(K)N(0) sin0 

— sin (qx) , (17) 


\2K-1 


where 7 (K) = '(K) ^ a non_un i versa l con¬ 

stant. We see that these expressions reduce to those for 
the free helical liquid when K = 1. The electron-electron 
interactions reveal themselves in the \l\x'\^ K ~ x depen¬ 
dence and the prefactors of the range functions, as ex¬ 
pected for the ID interacting electrons ! 22 : 23 In contrast 
with the usual spin-1/2 LL and the Rashba quantum 
wire, in the present case, the exponent of l/|x| and the 
sign of 7 (K) may become negative when 1/4 < K < 1/2. 
We will see later that this sign change results in an impu¬ 
rity quantum phase transition for the two-impurity prob¬ 
lem. 


IV. THE TWO-IMPURITY PROBLEM 


Here we consider the two-impurity problem. For sim¬ 
plicity, we consider the case with J± = J z = J so that 
Hrkky respects the spin U x (l) symmetry. To deter¬ 
mine the ground state of Hrkky , it suffices to study the 
rotated Hamiltonian 


Hrkky = U x (9)H RK kyUI(9) 


(18) 


= V(x) 


sin (qx)(S 1 x S 2 ) z — cos (qx) ^ S®S. 

a=x,y 


where V(x) = J 2 j(K)N( 0)/\x\ 2K 1 . 


A. Classical spins 

We first consider the classical spins, which should be 
valid when S 1. To proceed, we parametrize S t as 
Si = S (sin 9 i cos cfn, sin 6 i sin <j>i, cos 6 ;) fori = 1,2. Then, 
the corresponding energy E can be written as 

E(0i, <j>i) = — S 2 V(x) sin sin 62 cos (<j> 1 — </>2 — qx) . 

For K > 1/2, V(x) > 0. In this situation the ground 
state is obtained when sindi = 1 for i = 1,2 and 


cos(^i — <j) 2 — qx) = 1, which corresponds to 0i = 7r/2 
for i = 1,2 and 4>i~ 4>2 = qx module to 2tt. On the other 
hand, for 1/4 < K < 1/2, V(x) < 0. In this situation the 
ground state is obtained when sin0i = 1 for * = 1,2 and 
cos (4> 1 — <f >2 — qx) = — 1, which corresponds to 9i = tt /2 
for i = 1, 2 and 4>i — (f >2 = qx + n module to 27 t. To sum 
up, the ground state in the rotated basis corresponds 
to the planar spin structure Si = S/cosf^sinc/i,!)) for 
* = 1,2 with the relative angle </q — </>2 = qx + nir, where 
n is some integer. By transforming to the original basis, 
the spin configuration become 

Si = S/cos cj)i, sin fa cos 9, — sin sin 9) , (19) 

for i = 1 , 2 . We see that the spin configuration is not 
planar any more in the presence of the Rashba coupling. 

Using Eq. csD, we find that 

(Si ■ S 2 ) = cos (4>i - 4> 2 ) = ±S 2 cos (qx) , 

where the + and — signs correspond to AT > 1/2 and 
1/4 < K < 1/2, respectively, and (■■■) means the av¬ 
erage over <f >2 (or <j) 1 ). That is, the relative orientation 
between the two spins is independent of the Rashba cou¬ 
pling. The latter reveals itself through other “order pa¬ 
rameters” : 

(Si x S 2 ) = TS 2 sin (qx)( 0 , sin 9, cos 9) , 

leading to the the chiral spin configuration, and 

| ° 0 
0 cos 2 9 — | sin (29) , 

0 — | sin (29) sin 2 9 — | 

leading to the nematic spin configuration, where Q a b = 
(S 1 S 2 +S 1 S 2 — ^5 a bSi ■ S 2 ). In the above, the upper and 
lower signs correspond to K > 1/2 and 1/4 < K < 1/2, 
respectively. Hence, we may tune the spin configuration 
through the chemical potential and the strength of the 
Rashba coupling by external gate voltages. 


Qab = ±S 2 cos (qx) 


B. Spin-1/2 


Next, we turn into the spin-1/2 case. By choosing the 
basis as the eigenstates of the total spin S = S\ + S 2 , 
denoted by | S, S~), the rotated Hamiltonian Hrkky can 
be written as 


Hrkky 


V(x) 

2 


cos (qx) 
—i sin (qx) 


0 

0 


ism(qx) 0 0 
— cos (qx) 0 0 


0 0 0 
0 0 0 


with the basis {|0,0), 11, 0), |1,1), |1, — 1)}. It turns out 
that 1 1 , 1 ) and 1 1 , — 1 ) are still the eigenstates of Hrkky 
with energies E t ,± = 0. Nevertheless, the states |0,0) 
and 11,0) are mixed. The resulting eigenstates are 

| 0 ,+) = icos(ga;/ 2 )| 0 , 0 ) + sin (ga;/ 2 )|l, 0 ) , 

| 0 , —) = —isin(gx/ 2 )| 0 , 0 ) + cos (gx/ 2 )|l, 0 ) , 
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with energies E^.± = ±V(x)/2. We notice that all eigen¬ 
states of Hrkky are also the eigenstates of S z due to 
[S z , Hrkky] = 0. Since V(x) > 0 for K > 1/2 and 
V(x) <0 for 1/4 <K < 1/2, the ground state of Hrkky 
is |0, —) for K > 1/2 and |0, +) for 1/4 < K < 1/2. Since 
the two states are orthogonal to one another, we expect 
that there exists an impurity quantum phase transition 
by varying the value of K , which can be achieved by 
tuning the strength of the interaction or the Rashba cou¬ 
pling. 

In any case, the ground state has S z = 0 indicating the 
planar spin configuration, similar to the classical spins. 
The ground state in the original basis is given by |$±) = 
E/£(0)|O, ±). Using f7j(0)|O, 0) = |0, 0) and the spin-1 
representation of U x ( 0 ) 



/ 

cos 0+1 

2 

-^sin0 

cos 6 — 1 

2 

£ 4 ( 0 ) = 



cos 0 

— 7 = sin 0 
V2 


V 

cos 0—1 

2 

--^sin0 

COS 0+1 

2 


we may write |$±) as 


|<I>+) = —cos (qx/2) + cos 0 sin (qx/2 )]\-(—} 
v 2 

— -=[i cos {qx/2) — cos0 sin (qx/2)]\ —h) 
v 2 

sin 0 sin (gx/2)(| + +} + |-)) , (20) 

|4>„) = —^=[isin(gx/2) — cos 0 cos (gx/2)]| H—) 

V 2 

- -=[i sin ( qx/2 ) + cos 0 cos (qx/ 2)]| —h) 

V 2 

-I — 1 -= sin0cos (gx/2)(| + +) + |-)) . (21) 

V 2 


In Eqs. (l20l) and m, we have expanded |4>±) by the 
states |iSf, 5|) with + and — denoting spin-up and -down, 
respectively. 

From Eqs. (l20l) and (12T1) . we may tune the occupation 
probability of the two spins in some configuration by the 
external gate voltages through the chemical potential or 
the Rashba coupling. For example, the probability for 
the two spins in the configuration | H—) is given by 

P+ _ = i [l — sin 2 0 cos 2 (qx/2)] , (22) 

for K > 1/2 and 

P.{ _= ^ [l — sin 2 0 sin 2 (qx/2)] , (23) 

for 1/4 < K < 1/2. A plot of P ( as a function of 

a/vF is shown in Fig. [2] We have assumed that the sign 
of K — 1/2 does not change in the displayed values of 
a/vp. It is possible that K — 1/2 will change sign upon 
varying the value of a/vp. In that case, P+- will exhibit 
a discontinuous jump. 



a/v F 


FIG. 2 : (Color online) The occupation probability P+— of 
the configuration | -|—) as a function of a/vF. We have set 
\r,x\/vf = 0 . 17 T . The solid and dashed lines correspond to 
K > 1/2 and 1/4 < K < 1 / 2 , respectively. 


One may also calculate the expectation values of vari¬ 
ous “order parameters” using |i>±), yielding 

(Si ■ S 2 ) = ~ ± ^cos(qx) , 

(Si x S 2 ) = sin(ga;)(O,sin0,cos0) , 


and 


(Qab) 


1 \l 0 0 

- 0 cos 2 0 — | sin (20) 

0 — i sin (20) sin 2 0 — | 

x [1 ± cos (gx)] , 


where the upper and lower signs correspond to K > 1/2 
and 1/4 < K < 1/2, respectively. We see that the 0 
dependence of these “order parameters” is identical to 
that for classical spins. 


V. CONCLUSIONS AND DISCUSSIONS 

In summary, we have investigated the RKKY interac¬ 
tion between two local spins (quantum dots) mediated by 
the helical edges state of a QSHI based on a model that 
includes both the Rashba SOC and the electron-electron 
interaction. The former is an inevitable element in an 
asymmetric quantum well that realizes the QSHI, while 
the latter is crucial for any ID electron system. Our re¬ 
sults should be valid as long as the distance between the 
local spins is longer than the one setup by the inverse 
of the bulk energy gap, while smaller than the size of 
the Kondo screening cloud. Due to the breaking of the 
spin SU(2) symmetry, the resulting exchange interaction 
shows a nontrivial tensor structure, which is fixed by the 
spin symmetries of the system. Most importantly, by 
electrically controlling the strength of the Rashba cou¬ 
pling, one may change the way how the two local spins 
entangle together. Moreover, by varying the interaction 
strength, which may be achieved by tuning the strength 
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of the Rashba coupling, the excited and the ground states 
of the two spins may be switched, thus implying an im¬ 
purity quantum phase transition. 

In comparison with the result obtained in Ref. [l4j in 
which the Rashba SOC is not included, the main effects 
of adding the Rashba coupling are to rotate the in-plane 
non-collinear exchange interactions about the x-axis so 
that more non-collinear terms are generated, and the re¬ 
sulting range functions depend on the strength of the 
Rashba coupling. In the absence of the Rashba cou¬ 
pling, the only factor that can be changed by the ex¬ 
ternal gate voltage is the chemical potential. By adding 
the Rashba interaction, we have more freedom to control 
the correlations of local spins which should be important 
in spintronics and quantum computations. Furthermore, 
these non-collinear terms may be used to engineer ID 
spin models which may exhibit non-trivial spin orders 
due to the long range nature of the RKKY interaction 
and the presence of the SOC<2i 

For a non-interacting Rashba quantum wire, it has 
been established that the RKKY interaction becomes 
anisotropic, and thus has a tensorial character <2^— 
Moreover, there are different spatial oscillation peri¬ 
ods reflecting the presence of different Fermi momenta 
in a Rashba quantum wire / 27,28 In the present case, 
there is only one spatial oscillation period reflecting a 
unique Fermi momentum, which is distinct from the 
usual Rashba quantum wire. Furthermore, practical cal¬ 
culations on the ID systems such as the Rashba quan¬ 
tum wires^ the carbon nanotubes^ and the graphene 


nanoribbons^ indicate that not all tensor forms will ap¬ 
pear in the RKKY interaction. Especially, the V n term 
of the nematic type is unique for the helical liquid with 
the Rashba SOC. The reason is that the helical liquid 
itself already exhibits a kind of SOC even in the absence 
of the Rashba coupling by breaking the spin SU(2) sym¬ 
metry down to the spin (1) symmetry. The inclusion 
of the Rashba coupling changes the spin symmetry of the 
system and leads to this nematic type interaction. 

Finally, we notice that the RKKY interaction me¬ 
diated by the helical Majorana edge states of a TR- 
invariant topological superconductor was discussed in a 
recent workJJi Due to the special feature of Majorana 
fermions, the Fermi energy is always pinned at zero such 
that the spatial oscillation for the usual RKKY interac¬ 
tion is absent. In that case, an impurity quantum phase 
transition was found due to the competition between the 
exchange interaction mediated by the bulk gapped exci¬ 
tation of the topological superconductor and that medi¬ 
ated by the gapless Majorana edge states. This is very 
different from our case where the quantum phase transi¬ 
tion is induced by varying strength of either the electron- 
electron interaction or the Rashba coupling. 
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